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PROBLEM TO BE SOLVED: To make one's own vehicle so as to be safely and easily retractable by having a 
birds-eye image converted into a ground-surface coordinate system projected with traffic lane data secured 
from a rear monitor camera with this rear monitor camera as a visual point and one's own vehicle, both 
compositely displayed on a monitor of an image display part, respectively. 

SOLUTION: An image signal out of a camera 1 is preprocessed for smoothenizing processing or the like in a 
preprocessing part 3, and then it is processed for binary-coded processing in a binary-coded processing part 4. 
In a white line extracting part 5, a white line as a traffic lane is extracted from this processing result. In addition, 
a center line extracting part 6 extracts a center line in the extracted white line. Data of this center line is 
converted into the data of a ground-surface coordinate system projected with the camera 1 as a visual point, 
thereby forming a birds-eye image. This bird-eye image secured in a transparentness conversion part 7 is 
coordinate-converted, generating line image data corresponding to a display image plane of a birds-eye view 
display part 2a of an image display part, and further an image displayed with one's own vehicle is composed at 
the specified position of a monitor image. This composition conduces when it retreats. 



Patent Number: 
Publication date: 
Inventor(s): 
Applicant(s): 



JP1 021 1849 



1998-08-11 

HORIGUCHI AKINORI 
ISUZU MOTORS LTD 



Abstract 



Data supplied from the esp@cenet database - 12 





l of l 



5/5/2003 12:26 PM 



(19)B*HfctW (JP) 02) & H Jj^ f^f & (A) (ll)fcfWUH&BS^ 

^W¥10-211849 

(43)&HB ¥#10^(1998) 8 mi B 



(51)Inta. e «bwb# F I 

B 6 0 R 1/00 B 6 0 R 1/00 A 



SSI!* 5fcffl3fi »3R«©ft3 OL (49D 



(21)ttiH## 


»H¥9- 16356 


(7DH1HA 


000000170 










(22)tUKB 


¥*9#(1997) 1E30B 




*ssa/iiKffi*#6 Ti26# i n 






(72)S6W# 


mn wis 






















<74)ftSA 





(54) \m<»m\ *m&tjm%&&w 



(57) [gift] 



1 



11 



(2) 



^¥10-21 1849 



Ji^je Lxmmm*u<r>$&mmiznmth &b® 
a««*aw)i*etaflrt: LfcB«££&f 

wmm^z&vtzztzftmt iK&m&iMRZM 
sk. 

tOOOl] 

micmmwmi&mfmizxkLKhnv. mm ( f 
y f 9 > m±mz\mimimmx'b&ti* y i # 

Jffl 10>flWW:RltMvO*&. 
[0002] CO«?ia*«ffS8aSBftt ; t-i' 2tf 

4<TfcaBl»*«riE*J:9t:SaLTV^4. 

[00033 ztiizm&ifciiffitixte. mm. & 

BBT4 - 3 6 8 2 4 1 #&48£&t *T . 
JflwcJM&U FyJJVz&K-f&mSifimiZtiX^ 

h. 

[0004] z<nmw.x\t. narfcasra^aei/oi 

Z t tfi*WBt X o fc*- * £ 3 >" V •* 7 * Hac 

[000 5] § 7 fct-^fflWC. ^-y^S 

7- £ JIT i -5 fc F 7 A /^zm^rfh y^fA t * 

&. iowitu. A.y^5 7-$-atanrv^F 
t, mozoiza.z.-rmmz&tz-tznx: mx-n 



X\^hi.o ZttZ&Wm ( fttt ) J: 3 tern 

[00063 

imitfMikixot-tmm] u>l&#£>. Jtiao 

J: a fcflfllHM - 3 6 8 2 4 1 #&ffi(tij%3*l££S 

-rhzt\nmzmu\ 

[0007] ?%h-h . F y 4J*iflffii&&Ziti> t 

^-mwmiz&hbmmtmmztciim 

ttLtf±tXl£o. 

[0008] *o3s i coigHJi. *-?wm*t>tftmtf 

El lt=^L*:J:5&l 0 tSO^SffiJJPg (h 
<oi§£fcL 01 2 1: tin-fiat:, t£f£l3 
(ftftl3a, 13b) C0ttl4 3!)^^^7lOCiS^ 

3a, 1 3b#a6«ll$l 5 a, 1 5 b£;M7 1<91S 

^M^msf 1 6 $ < mto x 1 1 o . *<ntz#>. 

[0009] m2<Dwmz. vmrt&wx-mito* 
x\i^<r)frimim^ztx'b& . t%hh. 01 it 

T^ti. 0 Z&Wiztr* y 1 Srf&a L>t^. 
**^^2±t^$ixS^tJi^<, S$^i:'fc 

mmzbz>(r)fi*imLm<. m&#Emt%i. 

[00 10] ZtltZftLX. «HH l 7-24 9 196-t 
4»Bfc*5 v^Tti. S*«t* *7£i£BU $B<0^ 

[00 1 1 3 m3WSH(i. ^v^-fSfc*. 

F^^Ei-e-tf x^^mLm^t ^0 z t x-&h. 
[0012] ±is«oj: a tcsm^t* X'<r>MMX 
tiimrfhtz^^mmm 7-1732 
T-tl^$^Tv^*^ z<nm.X'\$.. WlL<r>ij&ccv 

Kb?. mm®f&tf*®t>**)iz%ht^ommzifA,x' 

[0013] Ltz1?->X*%mt. $W«om^re«Bf8 

w&mtzti^x. t&mzffi&uzx v&mvikwmz* 
Ltitmwm^-fizmTjkZithz t ^ mt-th. 



(3) 



^¥10-2 1 1849 



[00 14] 

i-hwmvsat . mmmwgtmzm&t ixm 
Kim?- 9 ixmwm£j$.?hm£m 

t. iffiitizttimbix^h. 

[0015] i^h-h^mxit. wMbm£ts\*x 

m&mzm&t ixmitzmMzmt itzw- 

[ooi6] z<r>mw®T-?zwMm&®w. m 
tss^s? ) (nmmm^zn^Lxm^x't m 

i o o 1 7 1 $ zomwigiT—? twi&Wp&co 

mfe&Wlz L£B<8£: A*BC££l£8flT'Bffi 

£*S *rtBffc**aH::Sc*£*iS . 
[0018] £*>I6*. BM^SScO-ooBfflrttft 

sot. vy-(j<&&im<7>]mt&&ffit(r)ttmm& 

[0019] JJEO*»»fc*ii'Vt . RJMBttfc S$ 
[00203 .UiCk •) . MmEftto&fiWBk . RfFtt 

« 3M?*»«rflBw * - ? mm £ JL 

$&\,z&^®%i,zmmimzitz>zttfx' 

[0021] 

itmm.<r)mmzfK\sXis*) , c^jtuffrctt. 
ussns-cft* 5 1 tia^srass i ocsas 

*U dOBffiSPlSSl Oatttftfl^tt. JJB*>*-*2 
[00 22] B&KUIS51 0«. ^5l36»feffi*5ft. 

6Bmfi^^i?3!aa-rsfrsasg53t, cagHtoaao 
<oai^fi^tJtL'r2ffl«g^fi : a 2fiftft^4 

at^ttaj-r&atsftajg&sfc. ^aatttAa&s-ctt 



to&mB&tixm&te&at lt*>jhih*5*»2 a 

j£g58i. KSB®T-^SrK^a52aW^fi[aH 
S*W*I^LfcB«lc*Jfc**BflteJ*»9i:. Ufi 
4H»3~9fc8»t*J»£>*5.X-*&lto&**> , <9.X- 
*Rjg»PSi:-C«JS3ivC^*. 
[0 02 3] fcfc. JWB»5*»2afcttJMfc*.X51 

oaiflB® *^i>o$r**!yi*>£ * fusts 5B® 

[0024]H2liHlK* Lfc*WMfc« iSPitt* 
■C&ft. JSIT. £*>70-**-hfc«8L'Ciaifc* 
[0025] 21\ z<r>yu-^-^-YX'\iiyyvm. 

[0026] £*>*£fc:liW£HrS'7 M/A-X 

h&mmtiim^imx'h^K z<r>XT~>rsizx 
[0027] isyh&wtf^vrizbzmsiz <*f 

7*S lff)y e s ) , BftmKl OtCiJ^TettOttaj 

[0 0 28] f ;M?lfr<9ffiA3ft£&££ 
ISBttU. 4-f . «*HI«B3t:tiv^T¥flHh«Sl (HH 
aBSB^fcTi&ftLT^BS^fcrsara) ^ 

aa<r««iafeifcLfea. 2ttft*aa«4fc:i3or»« 

l.@3ffiWJi$- "1" fcU -eixOTS: "0" k"T*2tt 

[0 0 29] 3fefca«SiaS«5fc:4iVvC, ^2ffi« 
S"«lfeflfcB«S:B5IS*t 0 LT*0*> 

BI3K*tJ:d«r*-^Bffl2 0t:*Jv^a«WL««i 
ilJSrffp (Xf "/7S 3 ) . 
[00 30] -t-LT. i«>J:3tcLTafflLfca«Offi 

4) . H4lc$tJ:3lcattWL«)iH14ICL^att>f> 
JilSBflCitLraBStt^dii:^. IMS 

■fz£tmk<tth9mx'bt>. 

[ 0 0 3 1 ] «rfi. # . H««350*&. aSS: 



(4) 



#^10-21 1849 



[00 32] Z0)£olZlX$#>tZ&®VfLff)$<mC 

l t $am 2 o— y^mr t (nm&itm 5 ^ 

±Tffltci5fti.e^4"'C«c L<mw&M®mt ix 
[0033] i-%h*>. m£&&7it*mm®6 

Tiz&m&tzemvmzmf-rh ur-yrs 

5) . 

[00343 zzx\ wm&mi t *<0a»S3fctf)lWts 

0 

cos x -sin 
sin x cos 

[00 37] ZZX\ ifeJ:ffi<iz = 0TJ>l)*>4.±ie^ 
S < 1 ) lift^Jkdt**. 

y" U ycos r+Hsin r 
-z" -I ycos r -Hcos x J 
[00 383 *#B!f Kfcft^y-^iHT 

C:&tH-i>338£fr o t H8 fcjjtf- J: o fc&£> . 
[00 39 3 -ttcbh. EM* (x", y". z")A>£ 

n.tcmm&(x, y, z> comm (z=o tc$>i»e 

MW>+'MU:*>jft ( x. y . 0 ) J4JJE«« < 2 ) fc*5 
V^TRKS«Sft<:aW(x". y". z")T*fc9. £ 
tL&xrv- y^WTiztm-t h z t Ji . f /y "rtftt 



*7Hiz$3Lttf>£R (0, 0. H) (CffiilU AT4 
U*r"Ci&hII| (xyWtB) KfcttSatl**-* L 

a tea?* 

[00353 ( x , y . z ) <9&£Q£rt 

«ttEIKS-*fc«IW«r*^ 9l!MW«HI* ( x", 

y", z") kLTjai-f*. 
[00 36] L^ot, &W3h (x, y, z) Wjft 
(x. y. z)£gKMx". y". z")<0<S(x\ 

y", z") M8frr*5$ttJJW>J:Sfc:*4. 
[»13 



|"y" 1= |o cos t -sin r ~| p 1 
Lz" J lo sin t cos r -J ^z-H J 



•5* (1) 



[ft2] 



(2) 



[00403 L^'ot, £IK (x", y". z") *> 

<>aa» ( a , $ ) <\<r>mir&iftX'*zixi . 

[004 13 
[»3] 



-a- 




-0- 





•5t (3) 



") z -• 

[00423 ( 3 ) £sU 2 ) tCft*ttltf»* 

x/ (ycos r 



-a- 




rf ■ 


-0- 




-f • 



[00433 <r<05S (4) fcfflWCxfcyfco 



[S4 3 
+Hsin r) 



(ysin t-Hcos r) / (ycos t+Hsin r) J 

S (4) 

m) tssa (mmmssk) x-t<fzztiz%z>. 

[00443 
[»5 3 

rH • a/ (- /Jcos r + f sia t) 



r+ f sin t) -I 



[004 5] Z<7)tk. B2(CR0. XfrrsstfiH 

[0046] ±I2<9 «fc 3 <Ctt±D±«>atBR x . yX'(0 
mtOim ( x , y ) «W ( 5 ) C J: 9*ftMirt:*> 



•H • (/Jsln T + fcos r) / (-/Jcos 

* (5) 



[0047] -f ( x. y ) KSiSfrffi 

[»6 3 



(5) 



&§8¥10-2 1184 9 



= Si ■ x -i 



y" =Sy • y -» 
[0048] *LT. (x B . y" ) £F7-f 

[0 04 9] 09tC*1-t-^Sffl2OWSa (x\ 
y*) RjSfcBWM&Sfrfc* 

-x* n i-Sy y + x*sM,/2 



5* (6) 

-*<D®£OizmZitKmz. 48Bttx' . y" (C 

MLT9o• \s\mitz>mm&. nix*, 

H*7] 



[ } 



: 



■* (7) 



-y- -■ --Si* x + y',,,,/2) 

[0 0 5 0] Lfc« { oT. tityix-fettzxtv-y 

¥MT±.0)WM<r>T-f ( a . $ ) tt. S ( 5 ) £5S 
( 7 ) KttA-f S w t «fc 0 . iteWSSTJ: 9 fc. K7 
4 /<fcfK**4JMH*-*BB2 0_LO^g ( x* , 

x* = -Sy • H (0sinv+ f cosr ) / ( - $cosv + f sinr ) 
+ x*sn E /2 



y*) (CjQJW&£i:a*C**. 
[0051 ] 



•* (8) 



lfS[9] 



y* = -Sy • H • a/ (■ 



[0052] JJB^C (8) . (9) *fflivt*»(e 

^) &S2Bffir-?£J«[2*-?Bffl20Ctt£Lft& 
Bffir-^t^-ri>^i:* ? "C#, 01 0fc^-fJ:?& 

[0 0 5 3] 02KM9. BftftBSffil Ott. . 
jK»9fc*5wr. JJW>J:3fc:LT£JlUtflfci 

K«fcT^-f& (^T7rS7). 
[0 0 54] Tfcfcfc. ;M?l<ia*WJCli£3*lT 

*i*ii:36»6. *±*^^2^7cW^¥S±-C^im 

[0 0 5 5] Wilf. *j<?l&ft(cffl£B8LTVi& 

3 0 £ V t H 1 0 ItZjprtX o t«rffitf5fi«fca 

LTff< id ltztf->X. Smm30<7)M 
BBT&fctf . *WE=*Bffl*>jy?*Bfl (SB) 
[0 0 5 6] JMMnMKH»2btt;M:?l*» 

zm&bMmm*&2atitmzm7jk-ttitf. 
m&m&wzwb&nfr* yva ^<mx-wm 

[0057] 



/8cosr+ f sinr ) + y*sm/2 

* ( 9 ) 

ts» LtzmMSkm^T-^ izgm lx aos* * 

£j£U 3UMBft£&i^L?Bfl^flW&i3l 
Bfc*W&f &«B*r-* LIoH«fl 

[0058] ® A£*«> J: 9 =5:^S<7)$M{:^I»^ 



[0059] ®M±frt>0M&lZ%&cr>X\ &W*<r>± 
*??B«R*8toT£*f-*£5W fi 8rif\ 

[B2] *IHHCa«»Btt«tSff$aB»A»^^ 

[03 ] *miiz®hmm?mmzg3m.£.h^x 2 
miw&itz&n&mmiiiLt:mz*Ltz®x'hh. 



(6) 



*f§8¥l 0-2 1 1849 



i®4 ] *mi£®hmmimft5Mms£i5^x2 
las j *m\£&hwmttmmmwx.*i^x* 

h. 

[06 3 4^£<X**H&l^&13«<c&vi-CJft 

[07 3 *%HBt^&$^^#^gg®fcffl^SS 

mmmmiMmmmthtiib^mwm ( i ) ?*> 

[08 ] *mizm%mm&%3ffi8imz.m^h& 
wmmmmmmmbt&mim ( 2 ) r» 
a. 

[01 0] *%mz®hm®im%$:®£mzt3^x 

[01 1 J «*S#£flSSB*i&aLfc-«W$r*iW> 

[01] 



[01 2 3 &^#$iS§£H£fg3iL£fliPf£&£;?-tf- 
[flrf-OliiBB3 

1 m%8mmt(*xy) 

2 a JMSSSI^SB 

2 b ;M7HffifUng8 

3 from* 

5 

7 m%.m 

8 iss^^sn 

9 .ft©0£jS£S 
10 

2 0 ^-^fflffi 

wl a& 

cl snoots 

0<K H-flr^ttra-XI4fflSa5»t«^. 



/2l 



# * 7 



2ffifk 





(7) 



ftgflTl 0-2 1 1 849 



[02] 107] 




m9] [inn 




(8) 



$ffl¥10-2 1 1849 



[05] 



»>5 1 





(9) !}$8m0-2 1 1849 



[08] 




[010] 




CL 



20 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 



□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




BLURRED OR ILLEGIBLE TEXT OR DRAWING 



